Sex-limited polymorphisms are an intriguing form of sexual dimorphism that offer unique opportunities to reconstruct the evolutionary changes that decouple male and female traits encoded by a shared genome. We investigated the genetic basis of a Mendelian female-limited color dimorphism (FLCD) that segregates in natural populations of more than 20 species of the Drosophila montium subgroup. In these species, females have alternative abdominal color morphs, light and dark, whereas males have only one color morph in each species. A comprehensive molecular phylogeny of the montium subgroup supports multiple origins of FLCD. Despite this, we mapped FLCD to the same locus in four distantly related species – the transcription factor POU domain motif 3 (pdm3), which acts as a repressor of abdominal pigmentation in D. melanogaster. In D. serrata, FLCD maps to a structural variant in the first intron of pdm3; however, this variant is not found in the three other species – D. kikkawai, D. leontia, and D. burlai – and sequence analysis strongly suggests the pdm3 alleles responsible for FLCD originated independently at least three times. We propose that cis-regulatory changes in pdm3 form sexually dimorphic and monomorphic alleles that segregate within species and are preserved, at least in one species, by structural variation. Surprisingly, pdm3 has not been implicated in the evolution of sex-specific pigmentation outside the montium subgroup, suggesting that the genetic paths to sexual dimorphism may be constrained within a clade, but variable across clades.